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|ie'ld testing of the LengtH 0»i*t of the Money, I 
I'Heasureapnt and Time Program .was conducted nith 23 el^ementary school 
glasses of educable aentally* handicapped (E^H)" children.,. The 218 Ss 
Here assigned to the experx»4nt^l group,' th^* Havthorne ^rb'up, or -Jthe 




skills .and vocabulary • However, the incxease wa^s not significantly 
[greater than that^ obtained by controls.. Analyses of bomaunity 
location effects in^igated that the unit was equally .effective in the 
urban and suBurban "communities, and apparently of even'*greater 
effectiveness in th6 rural ,afeas. Teachers expressed>a preference for 
the ujiit over other instructional materials, (GH) \ * I • » 
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A''^ * ' ^® Univei^illty ©f - Minnesota ^Resf arch, ^ Development and Demgnstration 



Center In EdjicAfion of Handicapped ' Children has been established to 
. Concentratfe on intervention strategies and maH^rials. which develois ^d 
* inprove iangu^ an4 conmunication, skills; in xoung handicapped children . 
-> • • , ^® ^^'JS teri oBJLectiye o,f the Center is to iTOprove the language^ 

' Jantf communication abilitil* of hWicapped children by means of tdel^' 
^tification of linguisticaily. and ^potentially linguistically handicapped 
' : • chil^drer^,. deve^poent tod avaluation of Intervention strategies with 
> ^ young fiandicapper^ children and dissemination of findings , and products 

of benefit' i:o yQung handicapped children. , . , ^ ^ 
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'\ Money, Measurement and- T^lae "Progtam f-^ 
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'•P»trl<il« h: -Krus.L Martha-L. Thurlow, James %\ Immure, .Arthur jf. Taylor^ 
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.ir. — ■ * Grdnbach (1963) 'defined '.'eyaliidtiM^" "the ' 

colf^Ctipn aad u|e'of infonaatton to make decislonjs about an educa- 
tlonal .program." J Tod often, .Jus true tional oaterliils have been placed 

' ' «*■< 

in the^ classroom uitHbut undergoing any type of evaluation, thus making V 
. school children p0:hapjs the "largest. sln^ile group of unprotected con-' 

smaers" (Cass, 19.73). This situation must be rekedied not just by ' 

, '• • . ■ 

^^8? aSj but also hy evaluating materials" as 

■* ■ • ■ ' ' . -J * ' 

. they ^re being developeci so t>tat they can bfe revised before publication. 

S9'riyen«fl967) has. diatlngulshed between* these two |^es of eval-!' 

; uatipn .ia^h^« def iriitipns of "formative" and "summative" 'evaluations. 

••Formative" evlluation Is defined as the assessment of an instructibnal 

- .productJduri«g Its deveO-opment. Its goal is,tc identity ways in, which 

. • t\tf Materials' can be modified* as th.>W being developeli in order to J_ 

optimize their effectiveness. "SuaBafcive"' evaluation Is dfefia^ae 

■",!'•. \ ■ 

the assessment: of the final (i.e., revised) instructional product.'^ 
Its purpose is to verify the worth of the product in a fleia-test: •\ 4 
aitua^lqp-, whtfre It is often compared to^ other products which attempt, 
to accoi^;Llsh fctmilar goals. 

. Over She past two yearf, iafttrtictional materfala jirdHuced by i-tfe 

• " ' *• 

• University of Minnesota's Researcff. Development and Dbionstration 
Center have been subjected ^o both formative and s4iafcive fevaluatlons. 
• , Th^se materials refei:rad-\o as the Money, Measurement and Time Program. 

• we" ^igned^ for educable mentally retarded (EMR) children. As each . 

f . ^ ' 



udit in ''the- Program V«»,l>M«§fdeyeloped, it underwent aifc^ infcentffvl ' 

^. f enaats^ve evaluat iou^Hprocess (ct «&ii8 .^Thurlow, Turiiure ' Tayl6r , s{ * 

•^^Howe, 1974),^ Reviatona of all units" w<re made on the baMs of the 

•feedback- from the • formative evajufttions."' liis was donll -In otder to • : 

prepare th^ utiits fSisl^e i4' a Xaj?ge-sc«le"^iIld-te6jC. •.Zhe's'uu^tive 

evaluation of the tmits o€curred.'aur^tig.'^liis Jield-te8t-, , . . " 

The present paper is a descrljtrlon ^^...the" sumoative evaluation of 

. ' • *. ' " { ' 

,'the M^sureaent .of 'Length Unit, one qf the Jive uflits^n the Wey^- 

Mlasiirement and Tija^ Prodr*^. Formative evaluation, of the* Unit' took' 

. place pver a period of 'nine months.' .Dicing the process of fbhsa%iyk" ' 

.evaluation, the' Uffiewas revised ^In accordance with- the results of ' 

;8eyeral li^ut sources in oifder to produce an' effective" instructional 

product for EMR children (cf.V Thurlow, Krus, Howe. Taylor,.* Tumuri, 

1974). TWe purpose of the* sionatlve evaluation of the Measurement 

of Lengt* Unit 4s to teat the effectlv^esa of t;he rei^ised unit and' 

* • J ' ^ ^ 

N ' ■ * ' , 1 

Its useabJAlty In the cl|a8roora >^hen -tnteractions .between Project 

The Money. Mgasuraaent md' Tiae Program * ^ - 
, The Money,, -Measurement and Time Program (Thurlowj layjlor, and 
Tumure, 1973) Us ife instructional program designed for young eJuck- 
tlonally haridlcapp^ ieamara. Th'e Prograi includes five, units: 1) 
Money, 2) Measurement of Length, 3) Measurement of Weight, 4) Time 
with the Clock, ind 5) Time with' the Calendar. Syat^natic 'instruction ' 
Is prdvided'iB these areas, wltihout requiring that the chJ Idren liave 
reading or computational skills. Further information' about the specific 
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Measureaent of Length Ualt ' ' ' ' 1 , 

•' ■ . ' , ■ ■ ' , 4 ^ 

The Measurement of .Length Unit; -like, the other units in the ^i:o'> 
gram.^was develope4 joinily by -educational practitioners and educa- ^ 

• * » ^ ' ^ ^ 

tional researchers, tsstgoal was to provide EMR 4ildr&i with an . " " 
understanding of length and its ineksurment'by|4evfel©plh| both vocabu- 
lary, and skills. Special stress was placed on the.*^omparatlve terms 
related to length (e.g.. long, . longer, longest, etc.).. jf needs 
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Instructional units in the Program is available in the Teacher's In- 

»j troduction to the Pr^ram (Thurlow, Taylor, and Turnure, ,1973). 'f 

■ • ■ , ■ / 

The Money,. Measurement and Time Program was developed from basic" 

ilearniifg strateglefs 'research,- such as research on meatal imagery and 

. . v^rl^al elaboration. It represents one hf the first attempts to trans- 

.(late these recently developed ireas of experiment^' 'risearch into ap 

• Instructional /ro'gramrfor' EMR' children.. * , , " ' ^ 

The general alms' of the Money.. Meaauremerit and Time Program we.re 

t5. develop vcteabulary and related skills-, and Nfurtheajore'," to ehhance 

general language development ' and the development « of effective learning 

strategies. Several specific goals of the Program included: 1) ari- 

• . Improved understanding of the critical vocabulary.' and thereby better? 

. ;unde,gefanding/of the general area ofUnstruction (money, measurement, >C 

or .tlaije).^ 2) the development of beginning skills in the particular , ^ 

^ •.- ar^a of instruction, with 39 Aphasia, on the Vse'of these , skills- in 
- * Us . .'^ ■ ■ . 4 

everyday^sltuatlons^ 3) an incr^se In general language; espLlally 

. -fexp^essivi cimn^unlcation.and 4)^ thg use o:^ mdrf ^fef f iclent learning / . • 
and'-metiory 'strategies' in other Lthaa of inltrj^tion. ^' 



assessment,. conducted prlor-to the deVelbpment of instruction ' had 
revealed ^liat materials, available for teacliing length concepts were 
geared pr^rily for ch;Lldren of normal intelU&ence (e.g., they ' 
assumed .understanding of comparatives and units ^H^rked on^ddition 
probl6o8),'or for children with entry level sktlls (^»g. ,,readirik and/ 

"or counting skills) exce^g tl*)se of mo^^ children of elementary 
school* age. Eased upbn tL evidiSb larffSjJpropJiaf e •materials, an- ' 

instructional package consistent with a verbal elaboration-based' ap- 

.j»r^ach found to be succetsful witl EMR children .^Taylor, Xhurlow, and . 
Tumur.fe, 1974) was developed. " ' % 

-. Initially, the Measurement of Length Unit was produced in 4^1ot- 

t^t form whl6h vik -subjected to extp^iye f oraativfe evaluation And 

. rejvision (Thurlow, Krus, Howe, Taylor and Turnure, 1^7A). Th^'revl8e1' 

edition Was employed in the field- test and sulject to sunnative evalu- 

■ ■ • f 

ation^ It is the revised form which la described here.' ' 

The field-test version of the Measurement of Length U,nj 

included, three books of instruction. ' The first b'^^resented 

the comparatives of distance, height, and length. Vocabulary and ' " 

skills involved In measuring to the nearest foot were presented In 

the second book, and Instruction en measuring to the nearest inch 

was . presented in the third book. The, instruction in the three iooks ' 

•of the Measurement ol Le^th Unit was written' to stress the^radual 

afid^ closely structured development of both length vocabulary and re- 

lated measurement skills. The three books in thi Unit represent . 

progressive levels of instruction, from 4^ lowest to the most 

advanced. Children may begin dn theJJnlt at various points depending 
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\ . . , J . ■ • , • ' . - 

, on their beginning skills^ A book of Instruction might fake ftom a ° \ 

■ ^ • ^ ' * • ' ■ 

• ♦ ■ 'Couple of weeks to several 'kpnths complete, again depend^g on ' .• ■ 
thfe ability of tha- chilidren. '• Indivicfuallx adnviriiatered Assessnent - «, ' - 

^ instrurfent^ are proyldo^ f or iTilTlaL dlagnbstlk paaceraent' a^^ ,''{ * 

determining 'Knal achievement. . " ' . A y 

■■ . . # . _W 

, ' •. . The ins^uctional materials in the^ Measurenent of Length' Unit * ^, 

" ' ' ' •* ' ' ' * - ft 

• . included teacher's edi'tions (three .books), cassette tapes (fentalHng, ' 

, "• definition? and 'stories related to important -length concepts, .boojcs'"'-' •> 
■ : of pictures for the ichildren to- follow Ik the tape was presented . * ' 

' i - ■ • . - ■ ■ ^ 

* ^ «nd^nuirferoua worksheets ^nd transparencies to complete the instruction.' 
^E^ch book Is ccmposfid of.'lfssons that contain instruction related to I ' 
- one or more voeabulary. words. EaW lesson'i^ associated «ith "specif ic ^ 

, purpose and behavioral object«fes. The lessons within a\book are - ' # 
car.efully o^ered, with behkvioral objectives In one lesson being 
requisite .for adequate performance in later lessons. A lesson, which . . ' 
• usually require several periods of 'iristruction, includes three^Wjor / 
' . . coi^oneiitsi 1) pre-activltl|is wlwtch ihtroduce thejbncepts or review ' " 
.the peaning of necessary prerequisite, concepts; 2) tape presentation ' 
. whlc^^ develop the meaning of vocabulary words and the, gelations be- 
tween words; and 3) i^ost-actlvlties which' review and reinforce the 
concepts and^' relations established in ^e tape presentation. ' 

J *. The SuflBnatlve Evaluation Plan * 

* , 

^.^ The fiel^test^of the Meaaur^ent of Length Unit was carried 

out in cohji^ctionjhrlth the field-test of the Measureanent of ^ight 
■'Unit. Unforttmately, the desired field-test plan, in which classes • 



« ^ 



vould'be allowed to spend at least one year, if necessary, progressing 
through the Instruction in the Unit, could not be, implemented due to 
budget and time restrictions. Thuai., except for a few classes, in- 
struction in. the 'Measurement of Length. Unit was stopped after thr^ 
to four months so that the field-test of the Measurement of Weight 
Unit could be started in the sai&e classes. In the'^jEew e35c4>tiona'l ^' 
cases, classes continued; wfth the .Measurement of Length Unit; instruc- 
tion until the end of the year (i.e., af total instructional period 
of four to five months), without receiving instruction in any othpr ' 
unit. A sifflilar plan vias used to^ test the "Money and Tine with the 
Clock Units. 

- Method 

J . ■ ■■ — — 

Pesi^ . • t 

. For the suomative. evaluation of .the Measurement of Length Unit, 
.8 two factor design was «»pioyed. The .major factor of interest was 
the instructional' treatment factor. The thre^ treatments in the- 
present design were: 1) Experiniental, 2) lWfl?'orne, arid 3^ Control. 
The Experimental trelatment group ^represented those classes re-" 
^jselvlng the Measurement of. Length instru6tional progr^,- 

The Hawthorne treatment group consisted of classes receiving ' 
instruction in/ the Money Unit from the Money ^ Meagjur^enf* and Tlae' 
Program. The Hawthorne. group was Included in" the* design as one type, 
of control. Gains on the Length tests by this graup would represent 
changes in performance one could expect from the "novelty" of a new , ' 
program in^the clas8irpt»m, interactions with testers,* "learning to 
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learn,*' -and several other related factors. Td conclude that the 
* • ' * * . I - * 

Measurement of Length Instructloji itself "contributed significantly 
to performance increases, ' one must discoyer that the Experimental 
group performed significantly better ,than the Hawthorne control 
group. " " * ^ . 

♦ The dontrol treatment group. represented those classes where 
teachers were- left on tiheir oyn,' either to teach or not- to teach 
length concepts. When these teachers choae to teach length, they 
were allowed to use any. materials available to thea-^e.g., published 
materials, teacher-developed Mterials, ||tc*)> but they were not » 
allowed to use the Measuroaen^ of ^^ength Unit frc^ the Monay, Measure 
ment^ and l^e Program, - \ ■ » 

- The second"^ factor in 'the design. was that jof community location 
(urban, rural, 9r suburban). Tn^ identlf ic^atilon of communities "as . 
urban, rural, or suburban concurred with the Ategorlzatiop scheme 
of. the Minnesota Department of Education. Urban coimnunitles included 
three of the four major cities, in Minnesota. Suburban conmuiiitles 
were ones which immediately adjoined these cities. Rural • conanunities 
Included those not covered by the above classification system'. It, 
should be jioted that these "rural" communities were somewhat atypical* 
For instance, » one contained two small colleges and another contained 
one. Also, academic and profeasiohal people lived in some of the 
**rural" communities and ccramiuted daily to work in a nearby urban 
CCTmunlty, 

Subj ects ^ 

The population employed for field-testing during the. summative 



8* ' • ■ - • 

evaluation was elementary achiol-aged ' educable mentally retarded 

^ children. Of the 23 classes eaqiloyed during the present fieldr 
test, eight classes (2 urban, 3 rural, and 3 suburban) were chosen 
to be in the' Experimental tcaattfent (i.e., they received instruction 
from' the Mea8urement-otJ,efigth Unit), eight .cllsses <2\rban, 3 rural, 
and 3 subtsrban) .were- included in the Hawthorne control treatment (±,e., 
they received instruction' In the Money Unit), and seven classes (2 
urban, 2 rural, and J suburban) were included in the Control' treatmant 
(i.e., they received Instruction from any source other than the Length. 
Unit, if "the teacher chose to give it ^to them). Assigrment of the 
classes to treatments was made so the lower functioning classes would 
be in the Experimental groupf'. xh^s was done in order that aoiae classes 
would enter the instriiction at the beginning of .the Unit, which was 
considered to provide instruction on especially low-level concepts. 

Overall, there were 70 children (16 urb^,- 23 rural, and 31 sub- 
urban) in the Experimental group, 76 (18 urban, 31 rural, and 27 
suburban) in the Bawthorne group; and 72 (18 urban, 23 rural, and 
^ suburban) in the Control group. It should be noted, however, 1 

that the spe&ific numb^g of children for which data from the tests 

• •■ . ' . 

•were available varied due to testing procedures (see below) and 

' ' • ■* 

absenteexsm. 

A summary of the chilcfren's ^Qsi ^mental ages' (MAs) and chrono-^ 
logical .^gas • (CA8)^cln the three treatment groups is presented In 
Table 1, along,jflt^ the results of a- one-way factorial- analysis on 
each measure. Again, it should be noted that the number of subjects ' 



Table 1 * : 

'Coi^arlteons Between the lliree TresTtiDeht Groups on 
, ' IQ, 1^ and CA 



x 

SD 

- Range 
n 



MAdaonths) 

SD • , 



figgerlmental 



Range 



GA(nionths) 
X 

■ SD 
Range 



68.7 
9.7 
47-89 
"64' 



69.6 
14. 
40-108' 
65 



99.3 

21.8 
63-145 
69 



Hawthorne 

^ ' 
72.3 
8.1 
47-89 

* 71 



77.1 

10.6 . 
47-105 
71 



106.5. 
13.9 
81-136 
71 



• Control 

74.3 

, 9". 4 
56-93,, 

64.. 

78.3 
14.5 
5i5-118 
64 



104.0, 
19.3 
75-142' 
70 



If 



7.51 
(p < .001) 



6.32 

(£ <'.005) 

/ 



''2.70 



•^'soaetlaes varies with the measure due to inccwipiete test data. 
Clearly J the thf ee ^oups did differ significantly in IQ level and 
level. A New^n-iteuis tes^.for difference between the IQ meana 
indicated that -the Control group had a significantly higher IQ than 
%perimental gr^up ^ < .01) and that the Hawtho;:ne grolip also . 
J had a significantly higher IQ 'than the Experimental group (d < .05). 
^ The Hawtlu>3:ne arid Control groups did not dif fer^ A N^raan-Keuls 

' . ' r k • ' ' - 

test on the 114 meajis similarly revealed that both the Control . , 

and Hswrthoime, < .OS) groups^had higher MAs than the ^erimental * 
group. The E3^erlpefctal and^ Hawthorne. groups did not differ signifi- 

cantiy.*-^ . v • 

^' * ' ' , ^ . * 

- ^ ^ Table 2 pt^ent's the IQ, ap* CA data arranged according to 

community location* One-w^^ factorial analyses revealed a significant. 

^^fect^faf coramiiiity,loc^tion;for ^each measure. Newman-Keuls test for 

^ dlffMenc-es InHlcatedtthat children in both the rura^l and. urban 

coiamun\ti«s. haa significantly higher mean CAa and MAs than those in ' 

the suburban coonaunity (all £8. < .01), with the-«rural8'al8o/signifcantly 

. ^ 'V' • f . -i' ■ "-^ ' • ' 

higher than the- urbans- in. termf of MA level k .01). In terms of 
mean IQs/ the. suburban. (£ < *01^and the rural (2. '< •OS) coiaaunities 
. wer^*higher than the urban community. | 



-Tests 



\ IVo crite^^dn-refe'renced tests Vere aAninisterfd to the children, 
to de'teiri^ne, the 'effectiveness of the Mea'surraient of Length instruc- 
tlon. Each test was administered as a pre„test, and at the- iam^ time, 
to determine the plac|»ent* of a class witljin the sequence of instruction 
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Table 2 

Comparisons Betrfeen the Three Community 
ins on IQ, and CA 



V 



X. 
SD 
Range 
n 



HA (months) 
X 
SD 
Range 
n 



CA (months) 
- X 
3D 
Range 
n 



Urbiua 

68". 4 
9.6 
47-85 

44- 



75.8 
12.5 
50-103 
44 

{ 

111.2 
15.6 
78-144 

47' 



Rural 

71.7 

8,4 ' 
49-88 

/ 76 



81.4 
13.3 
40-118 

. 76 



112.6 
16.8 
78-145 
78 



Suburban' 



. 74.1 
9.6 

47-93 
79 



68.8 
12.5 
41-105 
80 



90. 7 

63-121 
85 



5.59 

'(L < J 005) 



18.74 • 
(p < .001) 



, 47.99 
(£ < .001) 



er|c 
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The same tests were administered after -Eiperlsiental groiip instruction 
in the Unit; was js topped. 

'^^^ Length Skills Test was a thirteen-item test designed to 
determine the child's functional understanding of the comparatives 
of length and his measuring skills. It consisted of three subtests * 
which evaluated skills ranging from the comparatives to actual-^ 
m^surement. This test was administered to all chlldiren (except, 
of course, those who were absent, etc,)* 

The Length' E xpressive Test was a fourteen-ltaa test designed 
primarily- to evaluate the child's ability to utilize "jeclflc vocabu- 
lary words. Xt consisted of "three subtests which corresponded to the 
three Instructional book* of the Measurment of Length Unit. This 
test was administered to only one-half of the children In each class 
in the present field- test* Administration was made randomly. The 
decision to reduce the data on this test was made In light of the 
excessive testing burdens put upon the teachers and children partici-- 
pating in the field-test. , 
*. A Cognitive Abilities \Test (Thorndike, Hagen, arid Lorge, 1968) 
was also administered to the children partlcipatii^in the presAit 
field-test. Since this test was anployed to evaluate the (gild's 
general Improvemert in aon-content-specif Ic areas of" cognitive 
functioning after a full year of instruction in the Money, Measurement 
and Tijne Program, the results of this test will not be described here. 

Proceaure , , 

The field-test of the Measurement of Length Unit was conducted 
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over a period of three to five montfis. The |oal of ' this field-test 
was, to assess the/Unlt under telatively "normal" classroom conditions 
with minimal Interaction between Project personnel and field-test 
participants. ' . ' 

Before instruction was started, children lu each class were pre- 
tested oh the. Length Tests (Skills and Expressive) ak the Cognitive ' 
Abilities Test. Then, each teacher in the 'EKpeflmental treatment 
group, attended a brief in-service t'ralning .^sslon designed to Intro-, 
duce the Money. Measurement and Time^ogram, the field-test plan. • 
^ and specifically, the Measurement of Length Unit.. Interactions with 
classes. stopped at. this point (except for "comment cards" returned 
to Project Djtrector6 when the teachers felt comments were necessary) , 
until posttesting time. ^ 

After instruction ended, clashes, were poi»J:tested on the Length 
tests. (The CogAiiive Ablllkes Test was administered at the end * 
of the year.)' At this point. Experlme-ntal teachers were requested to 
complete a detailed questionnaire on their reactions to the^Unit \ 
and to the Program In general. Control, teachers were alao ^ed^to 
describe any Instruction related to length tV^t the^r^M used ^ring 



the same .period,.^ ' 



^Approximately two months after Instructioh ^ t^^e Measurement of. - 
Length Unit j^md been stopped, a random simpiJ of children ',ho had. 
. received the Instruction were retested on the Length Skills Test and^^ , 
the Length Expressive Test. The purpose of. HAs retesting was Co' "\ % 
Obtain a measure^ content retention < * ^ . . i 



Results 



' The major sources o^ effectiveness data during the sunsnative 
evaluation of the Measurement of Le'igth Unit were the pretests and 
posttests. Because of absenteeism, testing procedures, ,scKool 



schedules, ^tc, only a limited number of> the children partdcipatipg 
in the .field-test received both thcs pretes-t and posttests for the 
Measurement of Length Unit. In or^der to benefit from the larger 
number of children in the total s'ample, it was decided that all pre- 
test data and all posttest data ,4rould be analyzed even though the 
results from the pretekt would include some children not" posttested, 
and^vice-ver^a. These results/ are presented in two sections: 1) 
Pretest comparisons, and 2) Pbsttest comparisons. 

The data from just those, childreft receiving both the pretests 

■ . . h . 

and the posttests are presented next. The pretest to posttest com-' 
jpfirisons on these data, although based on a reduced, sample size, are 

probab.y the most reliable/ far assessing the effectiveness of the 

/ ■ ' / ' 

Measurement of Length Unit. ' / 



Data related to the jierf or:mances' of children in the three treat- 

I 1. 
njent groups on individual test items are presei/ted next. These data 

not only provide further^ Information on the' effectiveness of the" Uittt 



^ / 



ibut also hfeve the potential for identifying/possible areas wh^re 

^ '*\ k , / " ■ 

revislons'-of the instructioB should be considered. 

' / / " ' 

The results section concludes with three additional sets of 

' * / • • / 

results. ^These results deal with: 1) Community location comparisons 

J 'H ' I . / 

2,1 Retention findings^' and 3) Feedback from teacher evaluations. 



I / 
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Table 3 

Comparisons of Three Treataent Groups on 



Length Skills anS Length Expressive Pretests' 



Length Skills Test (11 items) 



X 

sb 



^^kidmental - Hawthoi 



4^9 

f 

2.54 
'61 



orne 
5.22 
2V21 
40 . 



Length Expressive Test (13 Itans) 



Ekpegifaental -Hawthorne 



SD 



/ 



3.16 
2.59 
37 



4.08 
1.93 
35 



Control 
"5.4*. 
2.02 

- 40 



Cohtrel 
3.61- 
^ 2.03 
31 




F 

• 3. .78 
< .05) 



J. 

i.'ssV' 

(ns) " 



is 



c 



1 % 



16 '.. i 

Pret<i8t Comparisons 



A 



In order |:o f-ompare the posttest results of ^the three treatment* 

groups < and so, assesi the effectiveness of the Measurement 'of Length 

Unit), the pretest scores must fl^st be compared to show that there-. 

were no differences between the three treatment groups on the Length 

tests before inst?ruction. T^le 3 presents /he means and standard 
. - ■ ^ I ■' ' . 

^deviations of the^pret^est score's on the Length Skills and Length 

a one-way^ analysis of \^£ance v'' 



Expressive' tests, and the^r^ults of 
. Vfor .^acii te|t. - ' ^ ■ — ^ * ^ : • , 



^ Th#' results p^f the anklys:^^ ^ variance on the Length Skills Test' 
ftHjilcated that there were significant djtfferences between \he' thfjee 



\ 



f ■ 



^eatmetft groups. A Newoan-Keuls ^est revealed that both th^ Hawthorne 

f Control groups scored, higher th%n,^the Experimen^l gtot^ on M 

^ tikt (beth £s <'.05|. These dlffereSces very likely, reflect Ihe l^er ' 

IQ find *|A iCTels of^e Experimental group in-»the fleld-te^lT 0^ cpurse, 

such differences will necess^iyptave to be coniidered whin maling ^ * ' 
) 'V ■ . . 3 ' *■* « A. •■ • 

/ - the pdsttest comparisons on the skills test. .NK^slgnf leant differences ' 

were found" between the three groups on the Length Expressive pretest.. 

7 ' Posttest Comparisons ^ ' ^ . J - % 

' ^® "^^^s and|^ndard deviations of Ihe "posttast scores on the ' * 
Length Skills Test ^d theXsngth Expressive Test are .presented in 
Table 4, along w^h the results of oni-^y^^ly^of vAr lance oi 
^ each measure. A significant cond^ion ef %fet*waj not fouftd on either - >f-\ 



/' 



{ 



■2. 





^ ' ' Table' 4 

Comparisons of Three Treatment Groups on 
Length Skills and Leafth Expressive Bosttests 
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t 



Length Skin ft r^ay <.;i it^ems) 



&cperfjnental 



\ 



SD 



1 

n 



5^98 / 
2.W.' 



58 



liavthorhe 
2.40 ^ 



L^njyth Expressive Tesfe (13 items) 
\ BiEperlmentat ' 



SD 
n 



5.73 
3.04; 
56 



i- 



Hfefthome 

' 2.56 

'34- 



I 



•7 



Control.- 
■ 6.80 
- 2.41 
30 



Control ' 
5.20 ' J 
2.37 
30 



1.01 



1^35 t 
(ns) , f 



\ 



1 



r 



ERIC ^ 



I 



/ « 



»«» 
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Tablf 5 

Prefest to Posttest Cosparlson of Subjects Keceivln^ 
both Pre and Post Length Skills Test v 



. Experimental 

« 

Pre Post 
X v4.54 6.27 • 
SD'' 2.62,* ^ 2. 60 " 
n °* 52 52 
* ' i - 6.40 

(£,< .005) 

- ■ V - ^ ■ 

Two-way Repeated Measures ANOVA 



Hawthorne 
vPre , Post 



5.15^ 5.89 
2*40 . 2.44 
27 ^ 27 
t - 1.74 
(E < .05) 



Sonrce of Variance 
Between Ss . t 



^eataent 



Error 



Within Ss 



Tests (Pre^ Post) 
Treat. X Test 
' Error 



df 
106 
2 

104 

107 
. 1 

104 

]\ 



IS 

9.85 
10.33 



98.25 

>' -4.46' 
.1.99 



.1 



Control 
Pre. Post 
5.50^ 6.75 
2.10 2.46 

t. - 3.56 
(jE. < .005) 



« 28 



< 1 



49.3? 
2.24 



ns 



£ < - .'01 
ns 



Pretest to Posttesrt Comparl80,ns 

The above separate analyses, of pretest scores and posttest 
scores does not adjust for the fact that all children were not both 
pretesf4d and posttested. In order to avoid some of the lladtatioas 
of these analyses, the scores of just those children receiving both • 
teats were analyzed. Table 5 presents the means and standard devia- 
tions for those children receiving both the Length Skills pretest and 
, the Length Skills posttest. ^ Table 6 presents similar data for the 
Length Expressive Test. As compared to ^the data in Table 3, there is 
a^significant decrease in the nuaiber of children assessed. Conseqiientjy 
the pretest and postteal means and standard deviations are^also somewhat 
different than those presented previously. 

The data in Table 5 are presented graphically in Flguice'l. 
Repeated measures t tests for each group indicated that all groups. 
Increased significantly from pretesting to posttesting. The Increase ' 
Was clearly largest for the acperimental group. A two-way repeated ' 
measures analysis of variance revealed significant differences between 
•pretest and posttest scores on the Length SUlls test. This analysis ' 
confirmed the conclusions drawn from the repeated measures t test. 

Data related, to pretest and' posttest performance on the. Length 
Sxpressive test are preserit^ in Table 6 and Figure 2. Repeated 
measures t tests for each group indicated that qnl( the Experimental ' 
and Control groups made significant changes fr^m/pretest to posttest. 
The Hawthorne ^roup showed a mall. decrease fro/ pretest to posttest. ' 
A.two-way repeated . measures analysts of variai^e op th^ same data ' ' 
teyealed significant differences between pretests and posttests, and • ' 
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. ^, • ' Table '6 

Pretest to Postte'st Comparisons of Subjects Receiving 
. both Pre and Post Length Expressive Test 



' ^Experiiffiental 



Hawthorne 



, Control 







Pre 


Post 


Pre 


Pt)8t 


Pre ' Post 


0 


) 


X 


3.45 


6.39 


4.92 


4.83 ' 


. 3.78 • 5^43 






SD 


2.67 


3.12 


2.:06 


2.72 


2.15 2.33 

o' 






n 


31 


31 


\ ■ 12 


? *12 


23 , • 23 








t - 


7.12 




t < 1 


t - 3.38 








<£< 


.005) 




<ns) 


(£ <.005)- 





Two-way Repeated Measures ANOVA 



Source of V ariance 

- — -r 

Between Ss 

% 

Treatment 
Error 

Within Ss 

4 

Tests (Pre, Post) 
Treat. X Test 
Error 



64 
2 
62 

65 

i 

2 
62 



MS 

.1.35 
11.04 



124.12 
20.44 
2.60 



? ■ 



< l' 



47.74 
7.86 



ns 



£ < .01 
P < .01 



ERIC 



J 



23 



a significant treatment by test interaction (see Table 6). Tests ok 
simple ef|ect3 on the interaction indicated that at the pretest, there 
was a significant' difference between the treatment groups, with the 
Hawthorne group performing better than the other two groups (£ < .001). 
Significant differences also existed at the posttest <£ < .001), with 
the ajperimentals performing better-fehan the Controls, who in turn 
were performing better than the Hawthornes. The, crucial tests 
between pretest and posttest performancfes for ^ach group confirmed 
the finding of the repeated measures jt tests: both the Experimental 
group [¥ a, 62) - '^2.32, £ < .001] and the Control groups [F <1,62) « ^ 
12.07, £ < .01] showed a slMificant improvejment from pretest to post- 
test <other F <l). Observation of Figure 2, of course, further 
suggests that tije Improvement trend is most dramatic for the Experi- 
mental group Oft the Length Expressive test. From an Initial position 
of the lowest status '^mong the three groups, t|ie Eiiperlmental group , 
< Increased to the highest posi.tion. 

» * 

Item Analyses , 

The ^Length Skills and Expressive tests were criterion-referenced' 
tests, with items, being^irectly related to tl>«^behavioral objectives 

of the instruction. Table Tpresents the pretest and posttest percent 

\ • \ - ' ' . ■ 

correct- figures by test items for the Experimental treatment groups 
. * ■' ^ • - 

on the two Leqgth tests. The experimental group has* been -subdivided ' 

(■ * t >. 

into fou): groups which received differing amounts of Length iristruction. 

In this table, the items from the two te^ts have been integrated and 

gifouped according to where instruction related to both items appears 

in the/Unlt. ■ , - . ' 



V 
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Table 7 

Perceot E3q>erimentals Responding Cbrractly on Individual Items 
by Where Instruction, was Sapped 



Beginning to Book 1, £nd 

Labels f ar ^ 
Identifies farthest 
Identifies as close as 
Identifies taller tnan 
Labels tallest 
Identifies longest 
Demonstrates shorter than 
Labels shorter 
Orders shortest to longest 



Book 1, End to Book 2t End 

Labels measuring 
Identifies Measuring tools 
Describe9 seasuring tools 
Deaonstrates eeasureaent of 

how far 
Labels ruler 
Labels fool 
)teasure8 feet 
Labels lt>nger than foot 
Labels yard 



Book 2t End to Book 3^ .Lesson 2 

DeBonst rates inch 
Labels inches 
Measures inches 



Book 3^_ Lesson 2 to End 

Labels length 
Describes height ^ 
Measures feet and inches 



Over- 


Bk 1 


Bk 


2 


Bk 3 


Bk 


3 


< ' all 




End 








L2 




End 




Pre 


PosK Pre Post 


Pre 


Post 


Pre 


Post 


Pre 


Post 


22 


73 


0 


53 


0 


0 


30 


88 


22 


83 


74 


cH 


47 


67 


20 


50 


84 


94 


96 


96 


8 




0 


0 


20 


0 


10 


12 


9 


22 


wP 




53 


53 


0 


25 


79 




83 


65 


32 




0 


33 


33 


0 


30 


75 




78 


92 




80 


93 


80 


75 


100 


100 


96 


96 


52 




13 


33 


40 


50 


58 


81 


74 


91 


40 




ll' 


33 


33 


50 


' 40 


50 


60 


74 


v34 


55 


0 


40 


0 


0 


37 




61 


70 






ENDED 


















IHSTRUCTIOH 












59 


71 


33 


40 


33 


100 


60 


87 


80 


83 


50 


76 


20 


67 


40 


50 


47 


100 


74 


70 


' 5 


23 


0 


i3 


0 


50 


10 


6 


7 


39 


32 


53 


13 


20 


20 


0 


32 


68 


48 


6i 


65 


91 


11 


67 


33 


100 


80 


100 


93 


100 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


5 


17 


0 


0 


0 


0 


5 


19 


9 


30 


27 


61 


11 


13 


0 


50 


30 


88 


40 


74 


5 


18 


11 


0 


0 


0 


0 


12 


7 


35 










END^ 


















INSTRUCTION 








14 


33 


0 


7 


0 


0 


21 


38 


22* 


52~ 


30 


54 


0 


20 ' 


0 


0 


30 


44 


53 


87 


18 


40 


0 


0 


0 


0 


26 


38 


26 


74 














ENDED 


















INSTRUCTION 




11 


30 


0 


0 


0 


0 


0 


44 


27 


43 


14 


25 


0 


13 


0 


50 


0 


12 


27 


39 


3 


16 


'0 


0 


0 


5Q 


0 


0 


7 


35 


















ENDED 
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Observation of Table 7 indicates that for almost ^very item 
the Experimental subgroups showed marked increases f^dm pretest to ' 
posttest when they had received the relevant Instructibn. For example, . 
in the first grouping of items (^^ich ^11 sub iects should have mastered) 
there was growth on every, item except the one requiring that the> 4. 
children identify the concept "as close as.»* This was probably a 
yery difficult itan for SMR children, and more instruction may' be ^ 
indicated. However, groups which d; ' proceed farther in the instruction 
showed increases on. this item, , , 

The instruction also seemed to provide the children with skills ^ 
which enable them to correctly answer questions for ^hich^they have 
not received instruction. For instance, the children who received 
only Book One instruction were able to correctly answer many of the 
Book Two questions that they had missed on the pt^etest. With the ' 
other groups, there is a significant increase in almost all of the 
items from pretest to posttesf; The Length Unit appears to have 
been efficacious when specific items are inspected* * " 

Table 8 presents the same breakdown of test items as Table 7, 
but identifies th^ precentages of Experimental, Hawthorne, and Control 
subjects responding coriectly to each item. In addition, for^he\ ' 
Experimental group ^ it distinguishes between the percentages of those 
who received the instruction and those who did not. The Experimental 
subjects who received instruction did as well, and generally better, 
than the Hawthornes or Controls on most of the items* Experlmentals 
who did not receive the Length instruction related to certain items 
teiKied to respond like the Hawthornes* 
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P«r GMt Responding Correctly la Each'treiitMst Group' 
CO Iflidlvldual Xc«w * 



Vk U Bad 



Labels f «r 
Identifies ferthest 
Identifies ss close ss 
.Identmes teller thaa ' 
Labels tsllest 

Identifies Icmgest . ^ * ^ 

Oesonstrstes shorter then 
V LsbeH shorter ^ ' 

Orders ahortest to leogest 

Bk 1. End Bk 1^ End 

i^els Mssuring / 
, Identifies aessurlng tools 
.Describes nessurlag tools ^ 

Deaoostrstes aessurevent of hov far 
. Labels ruler 

Labels foot 

Measures feet 
^Labels longer Jthaa'foot 

Labele yard 

ik 2, End Bk 3. L 2 



Dewnstratea inch 
Labels x«ich4s 
Measures Inchss 



taparlmntals 
Overall 



73 
U 

12 
62' 
62 
98 
55 
-55, 
55 



71 
78 
23 
53 

n 

0 
17 
81 
18 



33 
54 
80 



•k 3. L 2 



End 



Labels l.»ngtb 
Describes height 
Heaeures feet 8 Incbee 



30 
25 
18 



ExperlHentals 
Eecelvlng 

Instruction 



73 
84 
12 
82 
82 
98 
55 
55 
55 



OMl) 
85- 
79 
27 
85 
100 
0 
23 
.78 

0lf39) 
46 
69 
56 



ai-23) 
43 
39 
35 



ExperlMntlftls 

Mot Eecel^ng 
Xnstru'ctloo 



{»-17) 
5 
16 
0 



(1^33) 
21 
15 
3 



>Hsvtbome 



32 
89 

11 
75 
65 
100 

41 
56 



\ 

Control 



37 

97 
13 
70 
57 
100 ' 
. 9 0^ 
> 50 
0 









0K15) 




40 


^ 68 


80' 


67 


68. 


83 


13 


26 


43 


20 


56 


60 


67 . 


94 


81 


0 


• :! ^ 


03 


0 




17 


13 


47 


'57 


0 


0 


0 



36 
.36 
42 



50 
57 
37 



29 
56 
12 



37 
57 
17 



Table 9 



Comparisons of the Length Skills l^dsttest Data' for the 



Three Community Locations In Ekch Treatment Group 



Urban 



^ ^perlmental 
SD 



Hawthorne 
X 



Control 



SD 



n 



Suburban 



5.25 , 


7.43/ 


''^ ■5.12 


2,49 


2.62 


2.64 




21 


' ^ "25 


.6.67 


* 

6.33 


6.25 


2.87 • 


. 2Ui' ' ' 


, 1.91 


9 




















1 




7.50 


7.89 


' 5.97 


f 

3.27 


1.62 


2.24 


\. 


9' . 


, 15 
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^ ' Table. 10 

qo»pari€^oiir of the Length Ebcpresslve Posttest Data for th« 
* Three Covmnlty Locations in Each JTreatmeat^oup 



iBxperlmental 
X 



Hawthorne 



Control 



Urban ' Rural Suburban 



\ 



4.90 7.19 ' 4.84 4.35'- 



, ' 1.85. ^. 3.p2 3.04 ' ^ <£ < .025) 



n 10 . 21 ' 25 



X 6.S67 5.89 ^ 4,20 



a4 



X 3.14 4.86 5.54 ' ' < 1 

SD 2.04 ; 2.74 2.37 . . (ns) 

° 7 . 14 13 



3..32 



. 2.34 1.45 2.48 ^ (£ < .05) 

n 6 9 15 



Cgaa mini^y Loc^tloh Compa^sons 

• .During the formatlre'ewaluation stage, the Measuranent ofl^engtb *• 
. Unit wasvwrltten by teachers^ who had taught In an urban comunlty andV ^ 
* :waa pilot-tested with urban children. To check the general effective-' 
'^q, of;the MeastjiFemei^of Length Unit for other' types of LnmuivLtles, • 
comparisons of results by location were made. 4 

. .. Ta^Ie 9 represents the/ Length Skills posttest performance' data , " ' " 
for the- three treatment groWs when further defined in Ce4s of community ' 
. location. Results of the one-way analysis carried %.oi} each tr^tm«.'q^- \. 
group are^also presented. Similar data for the Wfi ^^esWveMst 1 
are presented in Table 10. . w ^ . . ^ ^ 

Generally, the^ rural children s^red higher Uan- theil Vui?urban^ - \ * 
and urban peers. \hi8 difference was^ slgnif icant\ for^^^|4il,er1m^^rp^^ ^ 
group on both the Length Skills Test and the Lengih tpr^ssive Test! * 
The difference between Controls on the .Length Expressive test did not 
COBW out in a follow-up "New»an-Keu;8 t«t. It is likely ^that the 
community location differences noted are related to, placement ^practices " 
in the communities, and very likely that the differences Reflect the 
higher MA^evel of the rural children in the present sample. " 

Retention 

•J 

one of the aims of the developers of the Measurement of Length 
Unit was to produce materials which would result in relatively 
"permanent" increases in the EMR child's ability to talk ^bout length 
and actually measure length. To test for long term retention, the • 
Length Skills and Expressive tests were readministered to the Experl- 



Tableau ^ ' 

Length Skills and.Bkpred'slve Test Scores for Experimelltal 
* ^ Sub j€fct at Pcnrttesting and IVo Montha ^Later (detention) 



Post test . ; Retention 

\ 



Leagth'Skllls Test (ilji'tems) j-"' - 



-4" SD" / " 2.78 .V • -2.62 

' . / ,r ■ . : 58 ' • 42 



{ 



* ^ 

Length Expressive Test (13 items) 

X • 5.73 . 6.48 

t ^ 3.04 3.25 

n ' . -56 42 



li6 



mental subject^ about two months after instruction in the MeasurCi«ent 
of Length Unit had been stopped. j , . 

Forty-fwo children in the -Experimental group were given a, reten- 
tion test. These children were from the five classeg in which * 
instruction in the Measurement of Lengt? Unit was stopped, (xfife 
children in the three Experimental classes, that continued instruc Lion ' 
through the end of the year were not given the retention tests.) ^ 

Both the posttest and long,term retention data are presented in/ 
Table U. The'se data indicated that after two months, the Experimei^tal 

children had not forgotten, what they had learned about Length. In / 

j 

fact, their mean scores had actually Increased, although the increases 
were not statistically significant. What Is significant is the fact 
that the EMR youngsters, exposed to the Measurement of Length Unit ^ ^ 
for only twooaonths, had^ Increased their knowledge of length skills 
and vocabulary and had retained this knowledge for as long as two 
months. 

Teacher Ev aluation of the Len[ aitt^*I^n^ ^ 

^ Six of the Experimental group teachers 'answered a questionnaire 
about the lingth Unit. 4^ee Appendix 1 for a copy of the questionnaire.) 
The number of years of teaching experience these teacherfe had varied 
from 2 to 32, with a mean of 10.2 years and a stindard deviation of 
11.6 years. The number of years teaching handicapped children ranged 
from 2 to 17 ye4rs (f - mean 6.0 years, SD - 5.7). All teachers were 

H 

certified in special education, - ^ 



^dn th« evaluation forms, .the teachers Indicated that the taekn^^ 
preparation time for each teaching period was about 13 mlliutes* The, 
averajie length of each teaching period ^was i9 minutes; i^d the Unit 

generally taught every day of , the week* The room arrangement^ 
preferred by most teacliers vab one where the teacherl tape re&order, 
'and hbok were in the c^ter, with, the <^lldren on tlie floor around 

All, of the teachers enjoyed using the Measurement of Length 
Unit and would use It rather 'than another lengtjh Instructional 
package whoa they teach lengtTi again. However , two- thirds of the 
teachers indicated that they would also use supplementary materials* 
Sefv^te^ percent of the teachers itidicated the Unit beCa«e^"boring" 
' to'thea due to r^etition, but 66% of these also felt the repetitive- 
ness was necessary. In general, at least hatf of the teachers thought 
the l^^th Unit was )K>re .useable, ^ffecilve, and ^Joyable than other 
cennercial materials tidey hadjus^d. Half of the teachers felt that, 
all of the concepts covered in the L«igth Unit were Important to . 
child;^en in the long run, and the rest of the teachers reported^ that 
most df the concepts were necessary. All teachers feft the children 
would xm^ma^BT jLhB more importmit length concepts a year from the^ 
time they *learn^d thai, piejr also ^^or:ted Aat the materials were 
either "effective or "very , affective, Hrilf o^f th^ teachers thought,^ 
the children were more .interested in the instruction In the Measurer 
ment of Length Unit than they had been-^in other instruction. 

The teachers did make some recommendationo 06^ their evaluation 
foMs. Vfcile 83Z thought, that the Unit was complete it is, 201 



' cequested more inat^rucrfion at thp end pi the Unit dealing with 
measuring ^length.*' The^teachers also requested that tests designed 
to meastiR the children's progress te inserted^ into the instruction 
at the end of key lessons 5^ at' the end of each book. 

Other teacher reactions to the - insttructidn a summary of the 
data are ^available in Appendil' 2. ^ ' ' 

♦ V . • ■ ' 

The sum^tlve evaluation of the Measurement of Length Unit 
described In the present 'paper served to assess the effectiveness of 
the Unit for EMR children,*- airf. its useability in the classroom. The 
field-teat of the Onlt demonstrated that the Length Unit did increase 
the EMRl child's knowledge of length skilJ^s ami vocabulary' This ^ 
increase was signific^tly greater than that obtained ^by a Hawthorne 
control gipdtip, especially on .the Expressive measure (see Figure 2): 
The Increase ^as alsq greater than tliat obtained by the Control group, 
but *not significantly so* * ^ ^ 

, Tne p^f ormance levels on indivi(|ual items further 8up;y6rt^d the 
effecUv'eness of the instruction in the H-easuraaent of Length Unit. 

When\he data were analysed in terms of whether or not instruction' 

■ , ' ^ " --J 

related to 'a specific item was recislved, tht. expected differences 

_ c ^ .. . • . 

between the. three, treatment groups were generally observed (aee 

Table 8). - ' ■ . • . 

• ' - * . ! . 

/ Ftirtber support for .'the Measurement of Length Unit comes frijm ' 

the' retention data cdllected about two months after instruction ^ 

ended. These data indicated that the skills and vocabulary learned 
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from the Measurement of Length Unit were retained, and had even in- 
creai^d to sc^ne degree, after an interval of two.moiiths, U 

Analyses of conanunity Ij^catlon effects indicated thaiHihe Unit 
was equally effective in the urban an4 suliul-ban comunitieB, and' 
apparently of even greater effectiveness in the rural comnunities. 
This latter conclusion must iie viewed as tentative,' hdwever, since 
there were confounding effects of MA Jevel . 4 

-^"The useaWLlity of the ffeasuremenfe- of Length Unit for teachers 
was also doctmented as a result' of the pres«:it sumnative evaluation. 
All of the teachers who used the Unit indicated that they liked it 
and would prefer using it to oth^r Instructional materials. Most of 
the teachers thought the materials offered more diversity than other 

materials, and were more usable, * effective andi enjoVable than other 

-0, ^ * * _ 

coioaercial materials they had used bei'ore* 

The relirt:ively high performance leyels of the Control group 

indicate that^ the Control teachers were quite successful in teaching 

length concepts without a program designed specifically fox* their 

children.^ Five of the six Control \teacKers indicated that they had * 

taught length concepts to their classes with -the time spent ranging 

from threei days to "daily" throughout the^ear. Only two of the five 

teachers used published curriculum materials; all used >aterial$ they 

had developed themselves. The good performance of the children. in 

the Control classes appear© to reflect the, success of their teaihetrs 

in preparing effective materials to teach length concepts, ft appears 

however, that the Measurement of Length Unit would be easier for 

teachers to use, es^cially for teachers who have not had time to 
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prepare their 6wn materials, and yet would ^resGlt in achievement" ' 
^ which is as good, and generally better,- than that resulting from, 
other materials*- The useability of the Length Unit is stipportfed by ' 

3 

. the responses to the evaluation fo-rms. 

The Measurement of Length Unit presents length 'skilj^ a'i^ 
vocabulary which have been id^tlf ied as' Important to the nomial ' 
development of any child, fespecially the young EMR child (cf. , 
Kolstoe. 1970; Nuffeid. 1969| Pejerson, 1973).;- The prpst data 
fi'rom the preseiiE field, test and from the formative, evaluation o!f the ' 
Length Uflit (c£., Thurlow, Krua, Howe, Taylor, & TvirnMrev 19^4) ' 
Indicated that' these length concepts, while Important for all children 
to learn, aire particularly difficult for retardfei (^iWen to' master' 
without instruction. The-mimmative evaluation of the Measurement of 
Length Unit^has demonstrated its effectiveness and useability In "the. 
Classroom-, a^ has verified the belief -that the'.Unit fulfills a need " 
in the education of the young EMR child.- o ' ^' 



; 37- 

References 



9 

i 



f 



Cass, J. , Help for„ consumers. -Saturday Review of Education . May, 19'73 

' k , . , ' ' . / 

.Crpabach, L.J. Course linprovefflent, thfrough evaluation. Teacher's' ^' . 
' College Record . 1963, 67^-683. " 

kolstoe, O.P. TeachlnR educable mentally retarded ehlldrpn . New York: , 
Belt, Rlne^rart & Winston, 1970. " ;: ' ^ 

Krus,' P.H., Thurlow. M.L., Turnure, J.E., TaHor, A.M., and HoWe r' 

The formative evaluation design of the Vocabulary Developmerit ' ' * • 
^ Project. Occasional Paper-, in preparation. Research, ' 

■ HfTfi**^^"^ ^"^^ Demonstration. Cfenter in Education of Handicapped 
Children, University of Minnesota, Minneapolis, %9l74. - ■ 

LathuB, G. Measuring teacher responses to Instructional materials. -In " 

jq. Armstrong m>)\ A sourcebook fot the evaluation of ^n«V r...^^^..^° 

aaterlaxs and meaia. "Madison, Wisconsin:, National Evaluatlo^T"" ~ 

■ Comlttae, 1973. -.^ . . 

. McLaughlin, J. A.. .Teacher evaluation of liistructlonal materials. In 
' - • J.R. Arostroag^Ed.),. A sourcebook for tW evaluation of in>^ f>nP- 

• t^nal materials and pftVUa. m.H4o»„, ^-t^^^^rrtr- rhrf niuil 

• ^ . Evaluation Committee, 1975 ' ' 

Peterson, -D.L. Functional aathematic^fbr the mentanv. r^^^f^gj^ 
Columbus, Ohio: Charles E. Merrill, 1973, 

Scriven, M. The methodology of evaluation.' In R.W. Tyler, R.M,*, Gagne, • ' 
.. and M.. Scriven- -(Eds.). Perspective of currl-culum evA1n«^^nn. , Iv^- 
Monogr»ph -Series on Curriculum Evalu ation. Chicago: Rand'"McNaiffr 

, ^ Teylor. A. M.. .Thurlow^ M.L., and Turnure, J.E.f Elabofation as an . 
< • . Instructional technique In the vocabulary development of EMR children, 
' ^search, I)evelopment and Demonstration Center 

in Education of Handic^ped Children, University of Minnesota, 
, ^ , Minneapolis, 1974,, ^ • - 

_Thomdike, R'.L., Hagetl, E.. and-i:5'r-i^,"'l. Cognitive abilltl ^.^ t..t . 
.Boston: Houghton pfflln, 1968 ' ~ ' : 

Thurlow, M;L,, Lus, P.H.,. Howe, R. , .Taylor, A.M., and lurnure, J.E. 
/ ^surement of Length Unit: -A formative Evaluation. Research Report. v ' 

ip preparation. Research Development and Demonstration Center in 
, 1^74!'^.^" Handicapped Children, University of Minnesota^ Minneapolis, 



. ThuiMow, Taylo^, A.M., and Turnure, J.E. The Money, Measurement and 

Time Program: Teacher'? introduction. Research', Development and 
\ tyi^nstration Canterin Education of Pandicapped Children, University 
of l^nnesota, Minneapolis, 197S, ' * ^ ^ y 

ERIC ■ : . ^^") ' 



footnotes 

%e suooative evaluation of " the Measurement, of Length Unit was "an 
intensive endeavor which ci^ld not '"have succeeded without the help^. 
and cooperation gf ^ny individuals? Appreciation is extende'd to all 
school systems partlcipa%dn8 in the field-test', and especlkly to, the 
teachers who used the materials. Special thanks a;:^ due to Joni 
Blumenfeld Trot.p whb scheduled and completed all te^stlng, and who 
. formed the major link' between. the Project and the teachers in the field- 
test, ' - * h ' 

is y 

2Arthur M.pTaylor Ip now Supervisor of P^rams for the T ally Retarded 
in the St.. Paul Public School System. His^ddrMi i. : ^Pecial Education 
Department; MR^ Program,, St. Paul. Minnesota 55103.^^' - ' 
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1.. Where did you start teaching in the Length Unit? 
3. 



Book 



Lesson 



Book 



Lesson 



Where did you stop teaming in th3 Length Unit? 

Please indicate: 
«• The. averagf pret>aration time for each teachiag period: 

bi The average length of each vaaching period; minutes * 

X c. The average number of teaching periods per five day week; / 

4. Please indicate the percentage of t±nm in which inetruction was given to; 



minutes 



/ 



Whole class 



% 



Sisall group s % 
Individuals % 



1, 



2, 



How did you feel about using the Length Unit? 

__ I enjoyed it very much ' 

I thought it was alright , 

. I would rather use something else next time 

Rave you used any other commercial materials or math texts to teach 
length concepts? » YES 

If YES , what did you use? ^ 



If given a choice of materials to use to teach leni^th: 

J would prefer to use this Length Unit rather than others 
t " I would use either this Length Unit or .other length 

materials; wouldn't titter 

I would prefer to supplement this Length UniJ with other 

«Aterlals 

I would prefer to use other materials all together 



Compdr^ to other comrcrcial materials, was the Length Unit 

More useable? ' YES 

^4 * ' ' More effective*? YES 

. More enjoyable? YES 



3. 



Did you get ^,ired of teaching with these loaterlals'? 

» Yes p the repetiveneas was boring 

SoMtimes, but the repetiveness is necessary 

to teach my students 
No, these materials pf fer move diversity than most 



NO 
NO 
NO 
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4# How iraportant do you think the concepts covered in the Length Unit are td the 
children in the long run? 

' All concepts are essential - 

" • Most concepts are necessary ' > 

j^. Concepts are good, but ncft necessary 



I ^ Most concepts are not needed 

5. Do you think the children will remember the faore important length concepts 

a year .from now? - YES NO 

6-, How effective were the materials: 

Very ef ferctive 

- Effective ^ ^ ^ 

-Could have been mor^ effective 
Not very, effective at all 

How interested were the children in the L^gth Instruction? 

More interested than usual 

About as interested as in other Instrtxctlon 

Not very Interested 



Please rate the following aspects of the^ Length Unit in terms of their appropriate- 
ness (or, , completeness), for you as the teacher *. Ratie each Item from 1 to 5, with 
1 being fhe least appropriate (or, con?)lere) and 5 being the -most appropriate Jor, 
complete)^. 



a. Inservice ' training 



b. Teacher's Editions, in gener^al 



c* Introductory pages to Teacher *s Editions 



^ d. Directions to teacher in lessons 



€• Pre-activities 



f . Lesson Organizers 



g. Scripts accompanying tape presentations 

h. lost-activities 



1. Worksheets 



j . Transparencies 
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Please rate the follpwing aspects of the Length Unit in terms of their * 
effectivenests, enjoyability , interest, and at tent ion- focusing ability, , 
for the children in your classroom. Rate eaqh item froii 1 to 5, with 
* 1 being the least effective (enjoyable, interesting, or attention-focu'slng) 
and 5 ,belng the most effective (enjoyable, interesting, or attention- ^ 
focusing) . 



a. Introductory lesson (for preparation) 



b. Benjie 



c. Pre-actlvities 



d. Tape recordings 
e« Worksheets 



f. Transparencies 



g. Art work in books, worksheets, .etc. 



h. Post-aictivities for review 



i* Post-activities to expand concepts. 



j. Post-activities to build skills 



Did you have any problems with the pre-testing and/or 

pes tr testing of the 'unit? 

If Y ES , what were the problems? 

Where did the pre-test results suggest that you start 
teaching the Length Uni^t? 



Did you agree with the recommended starting point? 

Did you teach all the lessons between the points at 
which you started and stopped instruction? 
If NO, what did you skip? 

At what men t a J. age would you recommend that children 
could start in the Length Unit? 




YES ^ NO 

\ 



Book Lesson 



YES 




YES NO 
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6,, Are there any children for whom you feel the Length Ualt is not appropriate? 

7. How long do yoiT think it would take your children to^complete the entire 
Length Unit?. 

8. How long do you think it would take your children to cover the same content 
' as presented in the Length Unit, without the use of the program? 



9. Which of the followfeg teacher-^administered assessiu. ^ devices would you 
. like to see added to the Teacher |:ditlons to evaluate the children's 
progress? % 

^ Lesson tests * • * 

»^ ^ Book tests 

Unit tests 

None . ' 



1. Look at the sequence of the entite L^gth Unit* Is there^any ' ^ 
way you would change the sequence? yfq 
If YES, how? ^ 



2. How do you feel about the coiapleteness of the Length Unit? " 

™_ Needs move instruction at the beginning 

Needs more instruction at the end 

Unit is coiig>lete las ft is 



NO 



Frequently, when a new program of instruction is introduced into a classroom, 
other individuals see and react to the materials. Please rateUhe reactions of 
. any of the following individuals to the Length materials, on a scale of 1 to 5 
(1 - negative reaction; 5 « positive reaction). ' or i to 3 

Principal 

Parents - 

^ Regular classroom teachers 

Aides 

Others , ^ 



Please indicate: *■ 

a* Number of years of teaching experience ' (include all teaching 
except strident teaching) 

b. Number of y ars teaching educationally t^icapped children " 

c. Are you certified in special education? YES" 



MO 



If you have the time and the inclination, are there any suggestions about the 
testing or the materials you would like to p.iare with us? 



Is there anything else you would like to tell us?* 

ER?c ; ■ 4s. 
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Teacheir Chatac?,eristlc8 

1. Number of year8\>f teaching experience 
(all except stude^ teaching)!' 



2. Number of y^rs teaching educationally 
handicapped children: 



3. All six teachers are certified in special 
education. 

Teaching Characteristics 

1. Average preparation time for each teaching 
period* (based on 5 responses) 



2. Average length of each teaching period. 



3* Average niadber o£ teaching periods per 
five day week* 



4. Room arrang^ients (based on 2 responses) 
a. •*Childr«i in desks with tape player la 

front of room J* 
b* "Children on floor or on chairs around 

tape recorder." 

< 

X recorder 
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X '» 10.2 years 
SD* 11-61 
Range: 2-33 



X " 6.0 yearsjy 
SD 5.69 
Range: 2-17 



X « 12.6 minutes 

SD - 5.13 

Range: 5-18 miiv^tes 

X » 18.7 minutes 
IS.- 2.04 

Range' 15-20 minutes 



X «,4.2 
Range: 3-5 



x^ X 

X X 
X X 

. X X-vX X 



children 



Neither of these, two teachers felt' any other 
arrangoaent would be more apijropriste* 



room 



General Reactions to the Length Unit * * * 

did yon feel about using the Length Unit?" 
^ ' " ^ " . 
g3% ^'I erijpyed It very much" \ 
17% "I thought it was all right" \ 
21 ' "I would rather use something els^ next tlmeV 

2* I ton : "Did you ^et tired of teaching with these* materials?" 

-iZl ''Yes, the repetiveness was boring" \ '' ^ 
66% "aometimes, but the repetiyeness is necessary 

. ^o teach my students" V ' 

17% "No/ these materialsr offer more diversity^ 
than most" 

?• 1£SE- "How Important do you think the concepts covered iik 
the Length Unit are to the children in the long run\" 

-50% ^'All^ncepts are essential" 
^ 5 . 0 % "Mbst concepts are necessary" ^ 

0% « "Concepts are good, but not necessary" 



<5 



Q% "Most concepts are not needed" 

' NOTE: One teacher conmiented that some concepts were too advanced 
^d thus confusing and unimportant for her age group. 

4» Item: "Do you ^think the children will remember the more lnlw)rtant 
Length concepts a year from now?" | 

100% Yes ^ No ^ • 

* NOTE J ^ One teacher felt that it depends on th^e individual ' 
child , 

5' l£j™v "H^^ effective were the materials?" 

17%- "Very effective" 
.83Z "Effective" 

- 0%> "Gould have been more effective" 



.0% . "Not very effective at all" 



6. Item; "How interested were the children in the Length 
^ Instruction?" 

_^5Q% "Hpre interested than usual" 

_50| * "About as interested as in other instruction" 

0% "Not very interested" 



Of 



Answers Co Specific Questions , ' 

1. When asked to naae ,other oateriaiV- the teachera had used 
to teach Length, the .foUowing. wer^- noted! 

Milton Bi^adleV flannel board objects and 
instructor curriculum miterlals, 
. One teacher noted »he used other materials, 
^ but aentloned no naases v 
Four teachers indicated they did not' use any 
other cofflnercial materials to teach 
length concepts , ■ * " 

' ^5 f^""^ a choice of materials to use "to teach 

Length, the following reactions were giv«i; 



02 
66% 
OX 



_33| "I would prefer to use I the Length Unit 
than others" 

"I would use this Length Unit or other 
l«jgth aaterialsi wouldn't ttatter'5* 
"I would prefer to', supploj^t this' Length 
Unit with othir •atfrials" 

"I wcHild prefer to use other materials ' 

all. together" 

ISjirlflf ''^^J** ""^^^ ^ *>^he^ cortiercial 

materials they ha<i*ed, the Lengtl^Un^t wm not^d as: 

More usuable? 83% m No ' 

More effective? 50% Yeai OTZ No 
More enjoyable? 15f Yes ' Ux No 

~'' tbat these units were more 

coB^dre'j.than others. < 

Two teakers only marked one of the above three 
concepts.' r ; ; 

. '' ■ * ' 

2. Itm: "At what Utal age vould you recoi;mend that children 
could start the Lecigth Unit?" 

# i 

t ' \ ^ t ^ " X «. 6 years 

' ' • SD « 1,26 

Range « 5-8 

— * uS^?"° ^^^l^^o"^ coaq,leUness of the money 

_M "He^s .iore xnstructlon at the beginning" 

N^eds acre Instruction at the end" ' . ' 
_£3Z Unit is coiq)lete as it is 



i 



t 



Item ; "Look at the sequence of th4 entire Length Unit. 
Is there Any way you y9Uld change the sequence?" 
(|lve reipons^s) ^ * 



Yes 



lOOZ No 



When asked to note the reactions of other Individuals to 
the Length, Materials, the- following were given: (ratlag Is^ 
on scale of 1-^^) '^.'^ ; ' ^ 

4' ^ Principal (Shy, 

4 ,.Par4ts 4^2) > . [ . 

y Regul^ classroom teaAers (N-2) 



0 / Others <N»0)"' 



Ite^ ; '"Which t>f the fo^Howing teacher-administered devices 
wouM you like to see added to the Teacher's Edition 
to evaluate the children's progress?" , ' * 



33% Lesson tests 
£QOk tests 
Unit tests 




ItjMS . "Are there any children for whom you^ feel the Length 
Unft is not appropriate?" 

Respdndes: 

i'Book 3 f<>r most of i^ Jd-ds,' was too harS^' 
^ ^8o" (two'' teachers said this) 

**Yes> a hyperactive child who could not 
sit and listen in a group - all work 
has to be one to one" 

••Yes" (oM teacher said "yes" but iid 
not explain). 

**Yes> I feel my regular math program suffered 
because it was robbed of 15 minutes eac^ 
day and many in my class would have grasped 
the concepts in your program in less time if 
given a little maturity or a higher mental age,^* 



Item; 



(a) "How long do you think it would take your children to 
complete the entire Length Unit? (b) Itow long do " . 
you thii^ it woixld take your children to cover the 
same content as presented in the Length Unit, without 
the use of the program?"^ 



£ b CH»5) . 

school year or longer same" 
4 months fuii year 

Book 2 - even had trouble here NR 

at least a whole school yMr 
16 weeks (not as thorough)^' 

O J 



5 1/2 months 
16 weeks 
1 year * 



E, Teacher Reactions to Specific Aspects* of length Unit (mean - 

rating on scale of 1 to 5, -from negative to positive; the ^ 

nuaber in parentheses is the N) . 

• ■ . C • ' 

/ ^proprlatene88. .f ' .Colttpleteness Average 

1. iQ-service training 3*4 (4) - , 2va (5) . 2.6 

2. TeacHer*8 Edition/ ' 4.e <5) ^ 5.0. j[6) 4.4 

general - ^ ' 

3. Introductory "pages . 4..6 (5) 4^5 (6) . 4.1 

4. Directions to teacher ; 4,'6 (5) ^ 5.0 (6) 4.4 

''in lessons ' \' 

,5; P^e-Actlvities " 4. 7 (6) 4.8 (5) 4.2 

6. Lesson Organizer ',, 4.4 (5)"^' '4.7 (6) 2.^ 

7. Scripts for tapes \7 • ' 4.3 '(6) 4.4(5) 4.2 

8. Pdst-Actlvitles , 4.8:(6) ^•8(5)| 4.2 

9. Worksheets. • 4.2 (6^ .4.4 (5) ^ 2.9 



" JS-0. Transparencies 4.4 4/5 (4) 



4.0 



I 



, NOTg: One teather would'; have liked to have had ©ore 

. . worksheets and transparencies. Another 'comiiented. 
- r ^ # that 80i|e 8CiU.pt8*where *1really bad." 

\ ^ \ ^ . ■ . , * 

.F.^f Children Reactions to Specif ic Aspect^^ of Length Unit (mean raizing 
, -;^;by teach^'^ scale of .1 to 5, t^om negative to posititre, the N 
is 6» unless otjierwise noted in parentheses) 

■ ' ' "* ' ^ . ' 

' ^ ' " . ^ Effeefcive- Enjoy.- Interest Attention Average 

' , . . - ne8§ ability ^ Focu^g 

:1. /Introductory. 4,0 4.2 ^ 4.2 . 4,0 4.i 

Lesf&nif: * 

%n^ie" , 4.5 / ' 4.S - .4.8 4.8 



4.1 



r 



. 3.- • Pre-Act'lVlties 4.7 ■ • 4.2 . 4.2 ' 4.2' 

^' '^^Pes 4.3 4.5; 4.5, , , 4.3 ' li-.J 

5. Transparencies' '3.8(5) ' 3.6(5) 4.2' (.5) ' ^».2(5) ' 3.5 "' 

6. Worksheets , 3.7 3.7 3.5 3.3 -3.7 (5) 

7. Art Work . ' 3.5' ^3.3 > 2.8 3.3 ' 3 3* 

8. Post Acts? Review' 4.3 ,. C2 4.2 4.2 ^.1 

9. Post Acts: E3q>and 3.7 4.2 4.2 ■ iill , 4.1 

10. Post Acts: Skills 3.> * 4.2 " . 4.2 4.2 / 4.2 ' 



Specific Questions about Materials in general (asked of "two 
teachers only) . \ . 

1. 'itmi "bid you like using the ?lg Picture Book?" 

One Ceacher said yes and the other one skid they were ok. 
She felt the pictures could be bigger anc^ better and that 
the coii?>aratlve8 should be very distinct. Also, she said 
hard boupd covers would be easier to handle. 

"Did you lite th^ children to Have their 
own texts?" 

50% Yes 50% ^ ' No 

' 2, Item; "How do you think the student texts should be 
■ supplied to the classroom^" 

' 50%^ "Only In the form of Big Picture Books" 
0% ' "Only In the form of individual Children's 

Picture Books" 
_50Z "In both form, with botli being ^sed during 

the sMie - tape' presentation" 
_0% "In both for?is^ with the teacher selecting 

the form to be used during a given tape 

presentation""" 
— 0% "In one ft)rm for certain books and the other 
^ form for other books^d.e,, as it is now) - 

3. It^i 'Vhat do* you think would be the moat ef f ectW and 

useful way to inform the teadher of the content of 
the tape presentations?" 

-100% Con^ete script (as it is) 
_ 0% ^'SuimnarY of script 
Q%^ No script at all 

4. It^:. '"Do you think the Money, Measurement ind^Time Program 

should be modified into a program of Individualized ' 
instruction?" 

"No" . ; 

"For my own needs - no, but I .can see where it 
^ would be beneficial." 

5* itea: "What do you feel would be the best way to introduce 
. a unit in the Money, Measurement and Time Progirar to 
a teacher planning to use it in the .classroom?" 

OS In-serviee trailing > 

lOgZ Written document, unit flow, books, etc. 

— 0% Both in-service training and written document. 



Teacher CoBBftent* (ones 'not specifically elicited'by questionnaire) 

1- "Xiie guide i^as 'too wordy' for me. It got to be a bit 
, ot a burden to :^ad much, I felt I needed to do 
this now. riowever, if I ^used it again, it would be 
faailta^. The guide is good for an inexperienced 
teacher*"' 

2: "As I said before, Book 3 is Just too difficult for 
my children, they couldn't ^t the terms." 

3. "I wovid have -liked -to teach measurement through the 
^ metric system since the metric system is what the . 

children will use in life.".. 

4. "I think the teacher administered tests wiuld be much 
better. I fetl 4 rapport must be developed between the 
child" and testeV/:o get the best results. The testers 
didn't e^fplain fcough. The testers were always rushing* 
They treated the ^st more ir ;antly ^han the childrln. 
I felt there wasn'^t understand. of .or for the children, 

I feel fhe information gained is not too valid because of , 
: thi^ situation:"' 

5. "The children in my classroom would look forward to Benjie 

.Their f^^orlte time was when Benjie talked to them 
on the tape -Jer." 
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